Papers with unsupervised pre-training method
Pre-Training Methods for Question Reranking (2024.eacl-short)
Copied to clipboard
| Challenge: | Existing methods for Question Answering to search for semantically similar questions are not suitable for new questions. |
| Approach: | They propose an unsupervised method for retrieving and ranking questions . they use a question retrieval model and a selection model to rerank questions based on their relevance . |
| Outcome: | The proposed method achieves state-of-the-art performance on QRC and Quora-match datasets . it provides better and cheaper access to answers than the system generated them . |
Improving Abstractive Dialogue Summarization with Hierarchical Pretraining and Topic Segment (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for meeting summary have limited the ability to deal with long-term dependency. |
| Approach: | They propose a hierarchical transformer encoder-decoder network with multi-task pre-training to capture key sentences at word level and generate them at word-level. |
| Outcome: | The proposed model is superior to the previous methods in meeting summary datasets AMI and ICSI. |